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Abstract 

D ■ 

■ While belief functions may be seen formally as a generalization of probabilistic distributions, 

the question of the interactions between belief functions and probability is still an issue in practice. 
This question is difficult, since the contexts of use of these theory are notably different and the 
semantics behind these theories are not exactly the same. A prominent issue is increasingly 
regarded by the community, that is the management of the conflicting information. Recent 
^w' ' works have introduced new rules for handling the conflict redistribution while combining belief 

functions. The notion of conflict, or its cancellation by an hypothesis of open world, seems by 
C/3 I itself to prevent a direct interpretation of belief function in a probabilistic framework. This paper 

addresses the question of a probabilistic interpretation of belief functions. It first introduces and 
implements a theoretically grounded rule, which is in essence an adaptive conjunctive rule. It 
is shown, how this rule is derived from a logical interpretation of the belief functions by means 
of a probabilistic multimodal logic; in addition, a concept of source independence is introduced, 
^-^ ■ based on a principle of entropy maximization. 
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1 Introduction 

^ ■ In [2l[3], A. Dempster introduced an elegant modelling of imprecise probabilistic beliefs, which for- 

H ; 

5t , mally implies a generalisation of probability, and a process for infering combinations of these beliefs. 
This seminal work completed by G. Shafer [1] initiated the theory of belief functions for manipulat- 
ing uncertain and imprecise information. However, while belief functions may be seen formally as a 
generalization of probabilistic distributions, the question of the interactions between belief functions 
and probability is still an issue in practice. Indeed, the contexts of use of these theory are notably 
different implying slightly different semantics in background. On the one hand, belief functions may 
deal with non technical sources of information, and as a consequence are also confronted inherently 
to conflictual information. On the other hand, the contexts of use of probability and bayesian rea- 
sonning are more technical and controlled, and prevent, for the most part, the issues of conflictual 
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information. It is often necessary to map the belief information to the probabihstic information 
for actual applications. As will be shown subsequently, some issue for a probabilistic interpretation 
of belief function is implied by the notion of conflict between the sources, which is a product of 
the conjunctive combination rule for fusing belief function. The conflict and the management of 
the conflict in the combination rules are topics of increasing interest for the community Recent 
works have proposed evolutions of the historical rule of Dempster and Shafer (DS) for managing 
the conflict; Lefevre and al explicitely introduced this issue [9], and many rule constructions fol- 
lowed iniEllinillllllSllIl] . Especially, Florea, Jousselme and al [8] proposed a family of rules which 
is adaptive with the conflict level. In this case, there is an important idea: the redistribution policy 
is now changing automatically as a function of the conflict. But this concern for the conflict is 
not new, and are for example ingredients of the famous rules of Dubois&Prade [6,7j or Yager |17j . 
The notion of conflict may be cancelled by an hypothesis of open world [15], but this open world 
hypothesis does not map to the common formalisms of probability, and have to be interpreted. By 
the way, the open world hypothesis does not prevent any practical consideration of the conflict [16j 
implied by the interpretation of the belief put on the empty set. 

This paper addresses the question of a probabilistic interpretation of belief functions. It is the con- 
tinuation of reflexions done in |19y20j. which introduced and implemented a theoretically grounded 
rule, obtained by applying a principle of sources independence based entropy maximization. This 
rule is in essence an adaptive conjunctive rule, where the conflict redistribution is automatically 
derived from the considered independence principle. It is shown that this rule identifies to the 
conjunctive rule in cases without conflict. This rule is an introduction to the definition and study 
of a multimodal logic for modelling beliefs, since it is indeed derived from this logic by applying 
the independence principle. We point out by means of the axiomatizations how the conflict may be 
interpreted from the logical level. 

This paper is divided in two parts. The first part introduces a methodology for computing combina- 
tion rules, on the basis of an entropic principle for defining the independence between the sources. 
It is started by a general discussion about belief functions in section [2l Section [3] settles a new 
methodology for deriving the combination rule, based on an entropic notion of sensor independence. 
Then, section U] discusses about the properties of the new rule and the implementations. A small 
example is considered as an illustration, but since the purpose of this paper is mainly theoretical, 
these experimental aspects are not developped. The second part exposes the logical fundaments of 
our methodology. Section [7] provides some logical backgrounds and introduces the definition of the 
multimodal logic. In section [HI it is shown how a logical combination rule is derivable from the logic. 
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In section [9l a non trivial model is defined, and properties concerning the probabilistic extension of 
the logic are deduced. Belief combination rules are then derived theoretically from the logical rule, 
by applying a maximization of the entropic information. Section [10] concludes. 



Part I 

A combination rule based on the entropy 
maximization principle 

2 Overview 

2.1 Frame of discernment 

In order to manipulate the information, it is necessary to have an algebraic representation of the 
events of the system. Various structures [211123] have been introduced recently, and in the most 
general case, distributive lattices may be used for this algebraic representation [23] • In this paper, 
however, we will restrict our reflexion to Boolean algebras, and especially to power sets, which are 
the historical and prominent structures used by the belief function community. 

Definition 1 (frame of discernment). It is given a finite Boolean algahra B = (G, n, U, ~, 0, i7) and 
a subset Q C G of propositions, called frame of discernment, which generates 

The frame of discernment G is the set of basical known events of our model, and the Boolean al- 
gebra B describes the logical interaction between the basical event of Q. Subsequently, the notations 
B® ^ B and G® = G are used, in order to mark the structures with their frames of discernment. 

While this paper addresses the general case of Boolean structures, it is known that power sets are 
sufficiently versatile structures, which may be equivalent representations of any finite Boolean al- 
gebra, and may as well include as substructures some lattice structures, like hyperpower sets [21].. 
Thus, a fundamental example of Boolean structure B® is the example of power sets. 

Example 2 (power set). • The frame of discernment identifies to singletons of a set so that 
e = {{uj}/u; € n}, 

• The Boolean algebra B® identifies to the algebra of the subsets ofQ, so that G® = 2^, and 
n,U,~,0,r2 are respectiveley the set intersection, set union, set complement, the empty set 
and the entire set . 

^ Which means that G is the set of all propositions derived from 0, fl, the elements of Q and the operators n, U, ~ . 



3 



2.2 Belief 

2.2.1 Basic belief asignment 

The information from different sources or expert is not reducible to the only logical representation. 
Information of real life are typically uncertain and imprecise and come with an uncertainty degree, 
or belief. In belief function theory, the basic belief assignment (bba) is a belief density, describing the 
information intrinsic to each proposition. This intrinsic information is the fraction of information 
of the proposition which is not inherited from connex propositions. There are two definitions of bba 
related respectively to an open world or a dosed world hypothesis. 

Definition 3 (basic belief assignment). Being given a finite Boolean algebra B® = (G'®,n,U,~ 
, 0, a basic belief assignment m to G® is a real valued function defined over G® such that: 

m{X) = 1 and m > , 

and: 

Open world hypothesis: No other constraint, 
Closed world hypothesis: m(0) = . 

The theory of Transferable Belief Model, as defined by Smets 115], implements typically the open 
world hypothesis. While the bba describes the information intrinsic to each proposition, the full 
belief of a proposition is potentially the compilation of the basic beliefs connex to this proposition. 
There is a pessimistic bound and an optimistic bound for the belief of a propostion, which are the 
credibility and the plausibility. 

Definition 4 (credibilty function). The cedibility Bel related to a bba m is defined for any X € G® 
by: 

Bel(X) = m{Y) = ^ m{Y) - m(0) . (1) 

The credibility is a pessimistic bound, only talking into account the belief of the propositions 
known with certainty. 

Definition 5 (plausibility function). The plausibility is defined by P1(X) = 1 — Bel(~ X) for any 
X €G® . 
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2.3 Combination rules 

A main contribution of the theory of behef functions consists in the combination rules. It is assumed 
that two or more sources of information are providing a viewpoint about the universe. These 
viewpoints are described by specific bba for each source. The question then is to make a unique 
representation of the information, i.e. a unique bba, from these several bbas. 

2.3.1 Conjunctive rule 

The conjunctive rule belief functions is a rule of reference for combining belief functions with the 
open world hypothesis. It is applied for fusing independent sources of information. 

Definition 6 (conjunctive combination). Let mi and m2 be 2 bbas over . The conjunctive 
combination mi ©n of mi and m2 is defined by: 



It is proved that mi ©n m2 is a bba when mi and m2 are bbas. However, the quantity mi ©n 
m2(0) , called degree of conflict, is not necessary zero, even if both mi and m2 meet the constraint 
mi(0) = 771-2(0) = 0. Thus, ©n is an acceptable combination rule when the open world hypothesis is 
made, like in the TBM, but it is not acceptable in general when the closed world hypothesis is done. 
However, there are classes of bbas for which the conjunctive rule is admissible for the closed world 
hypothesis, that is bbas restricted to Boolean substructures for which contradiction cannot be 
derived from the conjunction fi. In |2HI25]. Dezert and Smarandache proposed such a structure, the 
hyperpower set. On such structure, the conjunctive rule does not generate conflict and is admissible 
even with the closed world hypothesis. 

2.3.2 Conflict management with the closed world hypothesis 

In the general case, the conjunctive rule generates a degree of conflict, which is not complient with 
the closed world hypothesis. While many rules are based on the conjunctive rule, a management of 
the conflict is necessary and is implemented specifically by each rule. 

Dempster-Shafer rule. The historical rule of Dempster-Shafer [3,4J is based on the conjunctive 
rule, but handles the conflict as a normalization parameter. 

Deflnition 7 (Dempster-Shafer). Let mi and m2 be 2 bbas over . The Dempster-Shafer combi- 
nation mi ©Ds m2 of mi and m2 is defined by: 






(2) 



mi ©DS m2{X) 




(3) 



1 - z 
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where Z = nii 0n m2{$) is the degree of conflict and: 

/[X / 0] = 1 i/ X / , and /[X / 0] = i/ X = . 

Rules defined from a confict redistribution. Variety of rules have been proposed recently [5l 
[SllinillllllSllIl] , especially based on a conflict redistribution [9] . We will not give here a description 
of all these rules, but a principle of construction is proposed. 

The principle is to construct a combination rule from the conjunctive rule by redistributing the 
conflict. Being given a redistribution function r, it is defined the combination rule (Br by: 

mi © [r]m2{X) = mi (Bn fn2{X) + r{X\mi,m2) mi ©n ?Ti2(0) , (4) 

for any X G G® . The redistribution function r should be typically such that: 

r(0|mi, 7712) = -1 , ^ r(yjmi, 7712) = , (5) 
yeG© 

and: 

r(X[mi, 7712) > , for any X e G®\{0}. (6) 

But there are examples of redistribution laws [8] where the constraint ([6]) is relaxed. However, in 
this approach of Florea, Jousselme and a/, the redistribution function is conditionned by the conflict 
Z = mi ©n 771-2(0), which is a more specific conditionner than 777-1,777,2 

There are many possible rules deduced from the redistribution principle. Dempster-Shafer rule is 
among these rules: 

©DS = ©[r-Ds] where r^s{X\mi,m2) = ""^ , for any X G \ {0} . 

In this case, the redistribution is proportionnal to the conjunctively fused belief. 

The PCR5 (Proportional Conflict Redistribution no. 5) rule |13pi4) is another rule deduced from a 
redistribution of the conflict, i.e. ©pcR5 = ©['^PCRs] where: 

r^CK.{X\mi,m2) = \ (^^^E^^^ mi{7)Tm2{Y)'^'^''^'^'^^^ 

+ y /^^(^^ mi{Y)m2{X) 

for any X E G® \ {0} . Under that form, it appears clearly that PCR5 is based on a local conflict 
redistribution, attributed proportionnaly to the input basic belief. 
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The principle of conflict redistribution implies a potentially infinite variety of rules. The question 
now is how to decide for a rule or another? This choice is certainly dependent of the structure of 
the fusion problem. A theoretical criterion for such a choice is still an issue. 

In the next sections, we derive a theoretically grounded ruling method, for which the conflict redis- 
tribution is implied by a new concept of independence of the sources. The new rules are essentially 
computed from an entropic optimization problem. 

3 Entropic approach for the rule definition 

To begin with this new rule concept, we directly settle the concrete optimization principles of our 
method. The logical justification comes later in part [III 

3.1 Independent sources and entropy 

The idea is not completely new, and the entropy maximization principle has been linked to the 
conjunctive rule in [25]. It is noticed, that ©n could be derived from an entropic maximization: 

mi ©n m2{X) = ^ fo{Y, Z) , for any X G G® , 
Yr\Z=x 

/oGargmax- f {Y, Z) In f{Y, Z) 

under constraints: 
/>0, 

^ f{Y, Z) = m2{Z) , for any Z G G® , 

f{Y, Z) = mi{Y) , for any F G G® . 

Equation d?]) has a particular interpretation in the paradigm of information theory: /o is the law 
with maximal ignorance of the interaction between the marginal variables Y and Z, owing to the fact 
that the marginal law are mi and m2. By the way, independent sources of information should indeed 
provide a maximal ignorance of interaction between the maginal variables, so that the maximization 
of entropy appears as the good way to characterize independent sources. Since, in this case, the 
constraints are limited to the marginalizations, the solution to this maximization is: 

UY,Z)=mi{Y)m2{Z) , 

where is recognized the joint law of two independent variables. The definition d?]) works when 
the open world hypothesis is done. But when the closed world is hypothesized, new constaints are 



where: 
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implied and have to be added to the optimization problem. In regards to these considerations, a 
generalization of the notion of independance between variables is introduced now, and will be used 
for the definition of a new rule of combination. 

3.2 Independance of constrained variables 

Definition 8 (constrained independance). Let he given the variables Xi-g defined over the finite 

sets Ei-s respectively. Let po he a probability density defined over the joint variable {Xi-g) md let 
pi:s be the marginals of po over the variables Xi-s respectively. Let (p{-) be the constraint defined by 
(p : {p{Xi-s))(^Xi.s)eYl- i Ef ^ {false, true}^ is a vectorial Boolean mapping defined on any joint 
probability density p. Then, the variables Xi._s are independant in regards to the probability density 
Po and to the constraint ip{-) > i/ and only if po is the solution of the following optimization: 

PoG argmax ^ -p{Xi:s)lnp{Xi:s) , 

with respect to : 

p>0, (8) 
the marginality constraints : p{Xi-s) = Pi{^i) , 

the constraint : 0{p) = true . 

It is noticed that this concept is dependent of the variables set. For example, it is not necessary 
true that the variables of the subsequence Xi^ , • • • , Xi^^ arc independant in regards to the constraints, 
when Xi:s are. There is an exception however, when there is no constraint, i.e. (p{p) is always true. 
In such a case, it is proven by applying Kuhn- Tucker theorem that p{Xi.,s) = nj=i-s Pii-^i) ■ 
The notion of constrained independance is now applied to the definition of a combination rule; the 
sets are Ei = G®, and the constraint may be defined by = {^Xi-Jxi^seC^-^ > where: 

= false if p{Xi:s) > and p| = , 

i=l:s 

ipxv.s (p) — true otherwise. 
After simplification, this construction results in the following definition of the fusion rule. 

3.3 Entropy maximizing rule for a closed world 

Definition 9 (entropy maximizing rule). Let rrii-s be s bbas defined on G®, compliant with the 
closed world hypothesis. The combination rule ©H; named Entropy Maximizing Rule (EMR), is 
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defined by: 

mi®n---®iims{X) = ^ fo{Yi,s),foranyX£G^, 

n,=i:. y^=x 

where: 

/oGargmax- ^ f{Yi.s)lnf{Yi:s) 

under constraints: (9) 
/>0, 

= "T'i(^i) , for any i = 1 : s and Yi € 



fl = ^ f(Yi.,,) = 0, for any Yi.^ G 



i=l:s 

Corollary of the definition 10. 0h is compliant with the closed world hypothesis. 



Confiict management. In the definition of rule ©Hj the independence of the sources has been 
implemented practically by an entropic maximization principle. From this principle, the confict 
management is implied automatically. Nevertheless, the rule ©h is also able to reject the sources, 
when they are considered as definitively non compatible. The fundamental incompatibility of the 
sources is related to the feasibility of the constraints in ([9]). 

A glimpse of the logical background. The definition of mi ©h ■ ■ ■ ©H "i-s based on fo is the 
expression of hypotheses on the logical background, which require some caution when applying 
the rule. Especially, it is the joint result of a conservation of the beliefs during the combination 
and of a logical independence hypothesis. The constraints in ([9]) are also the consequence of the 
logical background. In particular, the constaint f]^^^.^Yi = ^ fiYi.s) = is related to the 
hypothesis that the sources are in coherence with the objective world. In the most general case, the 
Belief functions may be used for fusing subjective information, and different logical background and 
constraints should be considered for such information. However, the entropy maximization principle 
may be combined with many kinds of constraints, and we have potentially a general principle for 
defining rules. 

4 Properties and implementation 

This section is devoted to the development of basic properties of EMR and to practical implemen- 
tation on examples. The following definitions and notations are used in this section. 
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Definition 11 (probabilistic bba). A bba m is said to be probabilistic if there are propositions 
Xi, • • • , X„ G G® \ {0} such that: 

' i^j^Xi^Xj = % , 



m{Xj) = 1 and 



Moreover, when Xi, - • • , Xm are minimal non empty elements, that is: 



Y C. Xi implies y = for any i = 1 : n , 

then m is called a probability density over G® and the credibility Bel related to m is called the 

probability measure on G® derived from m. 

Notations. Subsequently, mi, • • • , are bbas on G® compliant with the closed world hypothesis. 

It is denoted by Belj ©h Belj the credibility function related to mj ©h ■ It is denoted by p a 
probability density over G® and by P the probability measure on G® derived from p . 

Now, we have first to explain some notions about belief sharpening and its converse, belief weakening. 
Belief weakening is commonly used by the community, especially when a reliability degree of the 
information is taken into account. These notions are introduced now, with some refinements. They 

are necessary subsequently. 

4.1 Belief sharpening 

Definition 12 (belief sharpening). A sharpening from mi to m2 is a mapping ri2 : G® x G® — > IR , 
such that ri2 > , and: 

• J2 '^12(^, Y)= Yl '^12(^, Y) = mi{X) , for any X G G® , 

YgG® Y:YCX 

• J2 ri2{X,Y)= J2 n2{X,Y) = m2{Y),foranyYeG^. 

XeG^ X-.YQX 

It is noticed that this definition implies: 

ri2(X, y) = for any {X, Y) G (G® x G®) such that Y %X . (10) 

A sharpening will move the basic belief from propositions to subpropositions, thus resulting in a 
more accurate assignment of the basic belief. We will also say that m2 is a sharpening of mi, 
or conversely that mi is a weakening of m2 , when exists a sharpening from mi to m2 . We will 
equivalently write the < relation for credibility functions: 

Bell < Bel2 4=^ mi < m2 . 

It is noticed that the sharpening implies an order relation on belief functions. 
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Property 13 (equivalence relation). Define the relation < on belief functions by: 

Bell < Bel2 if and only if there is a sharpening ri2 from Beli to Bel2 . 
Then, the relation <\ is an order relation, and in particular: 

< is transitive. // ri2 and are sharpenings respectively from Beli to Bel2, and from Bel2 to 

Bels , then ri3 defined bye 

,^ y.A n2(^i, ^2)^23(^2, ^3) 
rn{X,,X,)= ^ , (11) 

is a sharpening from Beli to Bels , 

<1 is reflexive. More precisely, there is only one sharpening r from Bel to Bel , which is defined by 
r{X, X) = m{X) and r{X, Y) = for any X,Y e such that Y X , 

< is antisymmetric. //ri2 and r2i are sharpenings respectively from Beli to Bel2, and from Bel2 

to Bell , then: 

ri2{X,X) = r2i{X,X) = mi(X) = m2{X) and ri2{X,Y) = r2i(X,y) = , 
for any X,Y e G^ such that X ^Y . 
Proof is done in appendix lAl 
Property 14. Beli < Bel2 implies Beli < Bel2 . 

Proof is done in appendix |X1 The converse is false. 
Example 15 (counterexample). Assume: 

G® = {0, A,B,G,AUB,BUC,CUA,(!}}, 

and define: 

mi{A UB) = mi{BuG) = 0.5 = m2{B) = m2{n) . 
It is obvious that Beli < Bel2, but it is also clear that Beli Bel2 . 
Property 16. Probability measures are minimal for <1. More precisely: 

P <] Bel implies P = Bel . 
The result is a direct consequence of the definitions. 



^Since ri2{Xi, X2) < m2{X2) and r23{X2, X3) < m2{X2) , it is noticed that (fTTj) is well defined by setting 

r-l2(-yi,^2)rg3(X2,X3) A ^ ^^^^ rUiiXi) = . 
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4.2 Properties of EMR 

Property 17 (commutativity) . Let a : [1, s] — > [1, s| be a permutation on Then: 
mi ©H ■ ■ ■ ©H mis exists if and only if m„(i^ ©h • • • ©H m^f^s-^ exists , 

and: 

mi ©H • • • ©H m-s = m^(i) ©h • • • ©h m^(s) • 
The result is a direct consequence of the definitions. 
Property 18 (neutral element). Define the hha of total ignorance v by 1^(57) = 1 . Then: 

mi ©H • • • ©H ms ©H exists if and only if mi ©h • • • ©h ms exists , 

and: 

mi ©H • • • ©H m^ ©H = m-i ©H • • • ©H "Is . 
Proof is given in appendix 1X1 
Property 19 (conservation of belief). Assume that mi ©h • • • ©h m^ exists. Then: 

Belj < Bell ©h • • • ©h Bel^ for any i = 1 : s . (12) 
Proof is given in appendix lAl 
Corollary 20. 

Bell ©H ■ ■ ■ ©H Bels > max Belj . 

i=l:s 

Corollary 21. Let Xi, - ■ ■ , X„ G be such that Xi {~\ Xj =% for any i ^ j ■ Then: 

n 

The existence of mi ©h • • • ©h m^ implies > max Belj {Xj ) < 1 . 

^ — ' i=l:s 
J = l 

This result is a sufficient criterion for proving the non-existence of mi ©h • • • ©h m^. 

Property 22 (combination of dominated belief functions). Assume that Belj < Bel for any i = 1 : s . 
Then Beli ©h ■ ■ ■ ©h Bel^ exists. 

Proof. Let rj be a sharpening from Belj to Bel, for i = \ : s. Since rj(Xj,X) < m{X), it is set: 

m{Xf-' JJ ri{Xi,X) = when m{X) = 0. 

i=l:s 

Then, define: 

f{Xi.,s) = m{xf-' n n{X,,X) . 

jSfeG© i=l.s 
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Prom the definition of ri{Xi,X), it is clear that: 

Yl r,{X,,X) = when X f] Xi 

i=l:s i=l:s 

As a consequence of this and of m(0) = 0, it comes that: 



m{X)^-' Yl n{X,, X) = when Q Xi = % . 

i=l:s i=l:s 

Then: 

fl X, = implies /(Xi:,) = 0. 

i=l:s 

Now, it is also derived: 

= Y r^{X,,X)miX)^-'m{Xy-^ = ^ r,{Xi, X) = mi{Xi) . 

Since it is also clear that / > , so there is a solution to the optimization Q . □ 

Property 23 (probabilistic bound). EMR is coherent with the probabilistic bounds: 

( Bell en • • • ©H Bels ©h P exists , 
Bel,- < P, for any i=l:s, implies { (13) 

\ Bell ©H • • • ©H Bel, ®^P = P . 

Proof is given in appendix lAl 

The interpretation of this result may not be obvious. It says that, when the sources of information 
are weakenings of a probabilistic law, then their fusion with this law exists and confirms the law. 
However, the fused bba Beli ©h • • • ©h Bel, obtained from the sources Beli:, alone is not necessary 
compatible with a probability P such that Belj < P for any i = 1 : s . In particular: 

{Belj < P, for any i=l:s, does not imply Beli ©h • • • ©h Bel, < P , 
Belj < P, for any i=l:s, does not imply (Beli ©h • • • ©h Bel,) ©h P exists . 

This result is an indirect consequence of the fact that ©h will add information by means of the 
independence principle. This is illustrated by the following counterexample. 

Example 24 (counterexample). Let mi, m2 and p be defined of over 

G® = {0, A,B,C,A\JB,BVJC,C\JA,%}, 

by: mi{A U B) = m2{A U B) = p{A) = mi{B U C) = m2{B U C) = p{C) = 0.5 . 

It comes out that Beli < P and Bel2 <\ P by redistributing the masses from AU B to A and from 
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B L) C to C. Since the combination does not generate any conflict, then mi ©h ^2 coincides with 
mi ©n iTT'2 so that: 

mi ©H m2iA UB) = mi ©h m2{B U C) = 0.25 and mi ©h m2{B) = 0.5 . 

Obviously, Beli©HBel2 P and (Beli ©HBel2) ©h-P does not exists, since otherwise (mi©H?7i2)ffiH 
p{X) > 0.5 forX = A,B,C. 

Property 25 (associativity). EMR is not associative. 

The counterexample of section [23] turns out to be a counterexample for the associativity. 

As a consequence, one have to distinguish between (mi ©h m2) ©h w-Sj "Zi ©h {m2 ©h w-s) and 
mi ©H m2 ©H m^, this last one being a simultaneous combination of mi:3 . 

Property 26 (idempotence) . EMR is not indempotent, but it is proved: 

m is probabilistic =^ m ©h • • • ©h m = m . (14) 

Proof is given in appendix 1X1 

4.3 Algorithm 

The optimization ([9]) is convex and is not difficult. However, its size increases exponentially. The 
gradient of H{f) = Ex^. -/(^i:s) In /(Xi^,) is: 

DfHif) = ^ -(1 + ln/(Xi;,)) df{Xi.,s) . 

Xl:s 

The following algorithm, based on the projected gradient, has been implemented: 

1. Initialize t = and the convergence step 

2. Find a feasible solution /q to the constraints of ([9]); a simplex is solved. If such a solution does 
not exist, then stop: the combination is not possible. Otherwise, continue on next step. 

3. Build Aft by solving the quadratic program: 

min J^(0t(l + In ft{Xi.,s)) + Aft{Xi.,s)f , 

under constraints: 
ft + Aft>0, ^ A/j(Xi;s) = , for any i = 1 : s and any 

^l:i-l^i + l:s 

S 

and []Xi = $^ Aft{Xi.,s) = for any Xi., . 

i=l 
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Table 1: Example of EMR implementation. 
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o 

P2 


72 


m = mi © 7712 


0.99 


0.01 


0.99 


0.01 


Rejection [Za(ie/i] 


0.501 





0.501 





Rejection 


0.499 





0.499 





m(a) = m{b) = 0.499 , m{{a, b, c}) = 0.002 


0.3 


0.1 


0.3 


0.1 


m{a) = m{h) = 0.3 , m(c) = 0.175 , m({a, 6, c}) = 0.225 


0.3 


0.05 


0.3 


0.05 


m{a) = m{h) = 0.3 , m(c) = 0.09375 , m({a, 6, c}) = 0.30625 


0.3 


0.01 


0.3 


0.01 


m{a) = m{h) = 0.3 , m(c) = 0.01975 , m({a, 6, c}) = 0.38025 



4. If H{ft + A/t) < then set Ot+i = ^t/2 and ft+i = ft , 

5. Else set ft+i = ft + Aft, 

6. Set t := t + 1 and reiterate from step [3] until full convergence. 
4.4 Experimentation 

We will consider the fusion of mi and m2 defined on the power set of {a, b, c} by: 

mi (a) = ai , mi (c) = 71 , mi ({o, 6, c}) = 1 — ai — 71 , 
m2{b) = (32 , m2{c) = 72 , m2({a, 6, c}) = 1 - /32 - 72 . 

Notice that Zadeh's example is a subcase where defined by ai = (^2 = 0,99 and 71 = 72 = 0.01 . 

The table [T] summarize the results of combnation by ©h for various cases. These examples express 
clearly the property of belief conservation, and the capacity of EMR to reject any combination which 
is not compatible with this property. 

5 Conclusion 

The rule EMR is a theoretically grounded combination rule, defined on the basis of: 

• constraints expressing the belief conservation, which is a desirable property, 

• an hypothesis of sources independence, which is generalized by means of a principle of infor- 
mation maximization. 

The good news is that such a rule exists. Especially, it is complient with the probabilistic bound 
property as expressed in section [23l The bad news is that such a rule is quite constraining and 
cannot be associative. Here comes a fundamental point related to the use of the hypothesis of 
independence. This hypothesis introduces information which may imply some confiicts with the 
ground truth expressed by means of a probability of reference P. The properties of sections [22] 
(combination of dominated belief functions) and [23] express that. More precisely, it is possible to 
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combine as many sources of information (even P itself!) which is compatible with P, so as to make 
the best approximation of P: 

Belj < P, for any i=l:s, implies Beli ©h ■ ■ ■ ©h Belg exists . 

But as soon as the rule has been applied, the introduction of information by means of the indepen- 
dence principle may implies conflicts with the ground truth: 

Belj < P, for any i=l:s, does not imply Beli ©h • • • ©h Bel^ <1 P . 

This finding leads us to question about the hypotheses of implementation of belief combination rules, 
at least in the context of a closed universe. We could give up with the property of belief conservation: 
this is actually what most rules do in practice, when redistributing the conjunctive conflict. We could 
resign ourself to implement the combination rule just as a final step of the fusion process, as this is 
suggested by the properties of EMR. However, such approach is practically impossible in regards to 
the combinatorics. But there is perhaps a third way: we could manipulate conditionnal propositions 
instead of absolute propositions, as is usually done: conditional propositions are efficient tools for 
handling the independence hypotheses. Conditionnal beliefs are not a new concept; the theoretical 
tools exist. Such an approach would lead to define some forms of reasoning similar to the Bayesian 
reasoning. 

Part II 

A multimodal logic for modelling beliefs 

Part U] introduced the rule EMR by applying a principle of sources independence based on a maxi- 
mization of the information. While the resulting optimization ([9]) appears as a natural extension in 
regards to the conjunctive rule, this problem and especially its constraints have not been justified 
clearly. The prupose of this second part is to address the question of belief combination from a 
logical point of view. Based on this logical interpretation, the definition ([9]) is implied. 

6 Belief functions, modality and probability 

Belief functions may be seen as a generalization of probabilistic distributions by combining im- 
precisions within the uncertainty. Belief functions are caracterized by the notion of basic belief 
assignment which will assign a basic belief to any element of the Boolean algebra. In this way, bbas 
may be seen as a generalization of probabilistic densities, which assign probabilistic densities to the 
minimal elements of the Boolean algebra. This difference implies the ability of belief functions for 



16 



manipulating imprecise information. It has also an algebraic consequence, by replacing the additiv- 
ity property by the sub-additivity property. The qualification of belief functions as a generalization 
of probabilities has been questionned, by arguing that belief functions were subcases of random sets. 
While this is true in some manner, an elementary interpretation of this theory by means of random 
sets is not able to seize some semantic subtilities behind belief functions. 

However, there is another way to concile probabilities and belief functions. This could be done by 
introducing the semantic at a logical level. While probabilities are constructed on a classical logical 
framework (Boolean algebras), it is still possible to implement probabilities on a non classical logic, 
and this how we will interpret belief functions. In [26], Ruspini derived a logical counterpart of the 
credibility function by means of an epistemic operator K representing the knowledge of the source 
of information. This operator was in fact related to the modal operator of system S5. He proposed a 
logical counterpart of basic belief assignment, i.e. the epistemic proposition denoted e{X), derived 
from logical combinations of the modal propositions as follows: 

e(X) =KX\ \J KY . (15) 

Subsequently, an equivalent construction is proposed on the basis of a multimodal logic. In our 
model, Beli(X), the credibility of X according to sensor z, is interpreted as the probability P{[{\X A 
-i[i]_L) of the modal proposition [i]X A -'[i]-L . 

Ruspini also introduced the principle of a logical combination rule: 

e{X)= IJ [e^{Y)r^e2{Z)]. (16) 
Ynz=x 

This combination rule is in fact an immediate consequence of an elaborated axiom directly inspired 
from the conjunctive combination rule formulated on the credibility functions: 

KX is true '^=^ there is Y, Z such that y n Z C X and KiY, KiZ are true. (17) 

Subsequently, we will go a step further in this way by deriving the logical combination rule (|16p 
from axioms of a multimodal logic. These axioms will be related to elementary properties of our 
deduction system. 

From ()16|) . Ruspini derived back Dempster-Shafer combination by applying the property P(ei(y) n 
e2{Z)) = P{ei{Y))P{e2{Z)) , which depicts a rough independence hypothesis of the sources. Since 
ei{Y) n 62 (Z) = whenever Y D Z = 9, this approach generates conflict and needs a normalization 
of the combination rule. In particular, it is possible to have i-*(0) > ; this is clearly not satisfying 
from a logical viewpoint. 
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Again, we will go further with this idea of Ruspini, but, this time, by implementing our principle 
of sources independence based on the information maximization. This principle takes care of the 
logical exclusions. Nevertheless, we will also handle the distinction between the open world and 
the closed world, by considering different axioms. Especially, closed worlds will be such that the 
modalities of the contradiction are necessarily a contradiction, i.e. [i]_L = _L , while open worlds will 
accept a relaxation of this constraint. 

7 Definition of a multimodal logic 

This section introduces a multimodal logic which is the backbone for a logical interpretaion of the 
rule EMR. This logic has been previously introduced in [18j . 

7.1 Language definition 

It is defined a finite set, P, called the set of atomic propositions. Atomic propositions of P are 
denoted p,q,r, - ■ ■ For simplicity, it will be assumed subsequently that the atomic propositions de- 
scribe a partition, that is the conjunction of different atomic propositions is the contradiction and 
the disjunction of all atomic propositions is a tautology. Although these strong hypotheses depart 
from usual axiomatization of classical logic, it is not a restriction, since it is known that is possible 
to construct a free Boolean algebra by means of a power set. 
It is defined the finite set I = {1, • • • , n}, describing n sources of information. 

Definition 27 (classical propositions). The set Cc of classical propositions is defined recursively 
by ± £ Cc , 'P and X e Cc for any X,Y e Cc ■ 

The classical propositions describe the logical information on the real world. 

Definition 28 (simple modal propositions). The set Cc{C\ of simple modal propositions are defined 
recursively by ± £ Cc[C] , P ^ ^C[C] , X £ Cc[C] for any X,Y £ Cc[c] , and [J]X £ Cc[C] for 
any X £ Cc and any non empty J C I . 

In Cc[c], modalities are only applied to classical propositions, resulting in a language free of 
nested modalities. This language contains all necessary elements for defining the belief reasonning 
at a logical level. Nevertheless, it is not closed under the modal operators, and the language of all 
modal propositions is prefered for this logical study. 

Definition 29 (modal propositions). The set C of modal propositions is defined recursively by 
J-£C,F(ZC,X^Y£C for any X,Y £ C , and [J]X £ C for any X £ C and any non empty 
J CI. 
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Propositions of L are denoted X, F, Z, • • • It is noticed that the empty modality [$]X is not 
defined in £, . The modal propositions describe the logical information according to the sources of 
information. Subsequently, the modal operator [J] describes logically the information received and 
interpreted by the set J of sources of information working conjointly. Practically, we are essentially 

interested by the information on the classical propositions, so that, although we authorize nested 
modal propositions like [J][iir]X, we will not deal with them in practice. 

The abbreviations ^X = X^±,X^Y = ^X^Y,X/\Y = ^{X -^^Y),T = ^1. are used, for 
any J C 7 and X, y G £ . The dual of [J]X is defined as < J> X = ^[J]^X . 

A multimodal logic is defined subsequently, by means of axioms and deductions rules. A proposition 
which is deduced from these axioms and rules is called a theorem. The following definition will be 
usefull subsequently: 

Definition 30. For any finite set of propositions E C C, it is defined: 

\E= \J X . (18) 

is often used subsequently. 

Definition 31 (logical equivalence). The logical equivalence = is defined by: 
X = Y if and only if X ^ Y and Y X are theorems. 

7.2 Axioms. 

The multimodal logic is defined by the following rules and axioms defined for any propositions 
X,Y € C and subsets J,KC.I: 

Classical Eixioms. 

Atomic propositions form a partition. vP is an axiom and {p A q) ^ -L is an axiom , for any 
atomic propositions p,q eP such that p q , 

Modus ponens. If X and X ^ Y are theorems, then y is a theorem , 

Modal rules and axioms: 

N. If X is a theorem, then [J]Y is a theorem , 
K. [J]{X -^Y)^ {[J]X [J]Y) is an axiom, 
T. [J]X ^ X is an axiom (optional), 
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Inc. [J]X [J L) K]X is an axiom , 

Ind. Let C P be a subset of atomic propositions. Using the notation (jlSp . the following 
proposition is an axiom: 

[JUK]^rE^ V (([J]vF) A ([K]vG)) . 

F,G C P 
FnGCE 

The hypothesis, that atomic propositions form a partiotion, is used for simplicity. On the first 
hand, it allows the introduction of general Boolean structures and not only free Boolean structures 
for characterizing the model of the world. On the second hand, it makes much more simple the 
definition of axiom Ind as well as the subsequent definition of the basic logical assignment. The 
rule N and axiom K are minimal requirements of modal systems, and express that the sources 
are logically coherent. The axiom T is optional and expresses that the sources provide information 
which are coherent with the ground truth. We will see that this axiom is in relation with the closed 
world hypothesis. The axiom Inc expresses that the sources are always contributing positively to the 
global knowledge. Incidentally, this axiom also expresses that the sources are working in coherence 
with each other at a the logical level. The axiom Ind expresses at the logical level that the sources 
are contributing independently to the global knowledge of the classical propostions, that is the joint 
knowledge [J L) K]X does not contains more information than the disjoint knowledges [J]y A [K]Z, 
where X, Y, Z are classial propositions such that (Y D Z) X . 

It is assumed subsequently that the reader is familiar with classical propositional logic and its main 
results. Some results are recalled subsequently about the logical equivalence. 

7.3 Logical equivalence 

Owing to the axioms and rules of classical logic, = is an equivalence relation on the propositions of 
C The equivalence class of a proposition X € C for the logical equivalence is denoted [XJ . Let 
Q C. The set of equivalence classes of propositions X € is also denoted [FJ . 

The logical operators are naturally infered on the classes of propositions. For example, it is defined 
IX\ A [Y\ = IX AY\, [J] [X\ = l[J]X\ ,. . . An order relation is also defined over [C\. 

Definition 32 (logical order). 

[X\ C \ Y\ if and only if X ^ Y is a theorem. 
The notation [X\ C [Y\ is used when [XJ C [yj and [X\ / [Y\ . 
Owing to the axioms, there is an morphism between 2^ and [Cc\ ■ '■ 
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Definition 33 (morphism). For any classical proposition X G Cq , it is defined pX be the set of 
atomic propositions such that [pj C \_X\ . 

pX = {peP / [p\c[x\} . (19) 

Property 34 (morphism). Any classical proposition is equivalent to proposition vpX : 

wxeCc, ix\ = [vpx\ . 

For any E,F , it is also derived: 

(vE) A (vF) = ^r{E n F) , (vF) V (vF) = v(F U F) . and ^vF = v(P \ F) . 
These are clear consequences of classical propositional logic. 

8 Deriving the combination rules 

8.1 Preliminary results 

Some useful logical theorems are now derived. These theorems are deduced without the help of the 
optional axiom T. 

Property 35 (modality is non-decreasing). 

If X Y is a theorem, then [J]X — > [J]Y is a theorem. . (20) 
This result is a direct consequence of N and K . 
Property 36 (modality and conjunction). 

{[J]XA[J]Y)^[J]{XAY). (21) 

This result is a consequence of the theorems {X AY) X , {X AY) Y , X ^ {Y ^ {X AY)) , 
N and K. 

Property 37 (modality and disjunction). 

{[J]X V [J]Y) [J]{X VY) is a theorem. (22) 
This result is a consequence of the theorems X ^ {X V Y) , Y {X y Y) , N and K. 
Property 38 (conjunction of heterogeneous modalities). 

{[J]X A[K]Y) ^[JUK]{X AY) . (23) 
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Deduced from theorems [J]X [J U K]X and [J U K]Y , derived from Inc. 



Property 39 (disjunction of heterogeneous modaUties). 



{[J]XV[K]X) [JUK]X . 



(24) 



Immediate consequence of Inc. 

8.2 Logical combination rule 
8.2.1 Preliminary definitions 

The notion of partition wih be useful for defining the logical combination. 

Definition 40 (partition) . A set of propositions, IL C. C is a partition of T if it satisfies: 

• The propositions of H are exclusive : X AY = 1. for any X,Y eH such that X ^Y , 

• The propositions of 11 are exhaustive: Vxgn X = 1' . 

Notice that 11 may contain _L, in this definition. The following property is a direct consequence 
of the definition. 

Property 41. Let 11 and A he two partitions ofT. Then: 



• The set of joint propositions T = {X AY / X E IL and Y E A} is a partition. 
8.2.2 Logical combination 

Principle of tiie logical combination. Let J, K C I he sources subsets, and X be any classical 
proposition. Arises the following issue: How to characterize the fused information [J U K]X from 
the primary information [J]X and [K]X . In order to solve this question, we introduce first the 
notion of basic logical assignments (bla) which constitute the elementary logical components of the 
information. 

Definition 42 (basic logical assignments). Let E CP The basic logical assignment (bla) related to 
the classical proposition vE and to sources subset J is the modal proposition {J)vE defined by: 




• Xi A yi = ^2 A y2 and {Xi,Yi) / (X2, F2) imply Xi AYi = X2 AY2 = ± , 

for any Xi,Yi G 11 and X2, 12 € A , 



(25) 




(26) 
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The bla {J)vE is the logical information, which the sources of set J attribute to proposition vE 
intrinsically. The information of {J)vE cannot be attributed to classical propositions smaller than 
vE. From the morphism property \3^ the definition extends to [Cc\ '■ 

Definition 43 (bla on classes). For any \_X\ G [Ccl , the basic logical assignment for \_X\ is defined 
by (J) \_X\ = (J) [vpXj . The bla (J) [X\ is also alternatively defined by: 

(J)LXJ=[J]LXJA^( V [J][Y\\ . (27) 

\[Yie[Cci:[Y\0[X] / 

The bias have interesting properties, which will imply the definition of a logical combination. 
Property 44 (exclusivity). The bias {J)vE, where E CP, are exclusive: 

yE,F CP , E ^ F ^ {J)vE A{J)vF = ± . (28) 

Proof is given in appendix iBl 
Property 45 (exhaustivity) . The bias {J)vE, where E CP, are exhaustive: 

y {J)vF = [J]^rE , and in particular: \/ ( J)vF = T . (29) 
FCE FCF 

Proof is given in appendix [Bl 
Corollary 46 (inversion). It is possible to define [J]\_X\ from the bias {J)\Y\ : 

V {J)[Y\ , for any [X\ G [Cc\ ■ (30) 

lJ]lX] = lY]elCci:[YiC[Xi 

It is deduced from these results that bbas constitute partitions: 

Corollary 47 (bla partition). The bias {J)vE, where E CP, constitute a partition ofT . 

Corollary 48 (joint bla partition). Let J,K C T The propositions {J)vE A {K)vF, where E,F C 
P, constitute a partition o/T . 

Based on these partitions, it is possible to express the logical combination: 

Property 49 (computing the combination). 

{JVJK)wE= \l {{J)wF A{K)wG) , for any E CP. (31) 
FnG=E 

Corollary 50. 

(J U K) [X\ = \l ((J) \Y\ A {K) [Z\ ) , for any [X\ G [Cc\ ■ (32) 

\Y\XZ\eVCc\:VY\AYZ\ = \_X\ 

23 



The proof of the main property will apply the following lemma. 
Lemma 51. 

[J\JK]^rE= \/ {[J]vF A [K]^rG) = \/ {{J)^rF A {K)^rG) . 

FnGCE FnGCE 

Proofs are given in appendix [Bj 

Property 52 (generalized combination). The combination L32\) happens to be associative and may 
be extended to s sources: 

( Ji U • • • U Js) [X\= y /\ (Ji) [Yi\ , for any [X\ G [^^J • (33) 

Lyi:.JeL£cJ:A,=i:. IY,] = IX\ i=^--s 

8.2.3 Processus of logical fusion 

As a conclusion, the fused sources J U if is computed from sources J and K as follows: 

• Build {H) [X\ by means oi^iov H = J,K, 

• Compute (J U K) [XJ by means of 

• Derive [J U K] [XJ by means of 1^, 
for any [X\ G [Cc\ ■ 

9 Model and consequences 

In this section, a model is constructed for the logic. This model is not complete, when embeded 
modalities are considered. However, if we restrict to the set of simple modal propositions, £(7[C]i 
the model has some completude properties, which will be useful for deriving the belief combination 
from the logical combination. The model is not based on a Kripke constuction. 

9.1 Model 
9.1.1 Definition 

Two models are constructed for the logic respectively without and with the optional axiom T. The 
models are quite similar, except for the minimal elements, denoted (/>(■ ■ ■). The elements (f)(j)Q, E\-yi) 
are defined for any £ P and a-ny Ei-n ^ P by: 

• Without axiom T : 

HPo,Ei..„) = {ipo,Ei.,„)} , (34) 
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• With axiom T : 

n 

4>{P0,El:n) = {{po,El:n)} , H Po ^ Ei , 

i=l 

(/)(po,-E'i:n) = {} otherwise. 
For any proposition p € P , it is defined: 

P= U 4>{p,Ei.n). 
For any C P , it is also defined: E = |Jpe_B P ■ 

Then, the model 2L of any proposition X € £ is defined recursively by: 

• p = p for any p gP and T = P , 

• X AY = X riY , XyY = X UY and = T\ X , for any X,Y eC, 

• For any non empty J Q I and X E /3, it is defined: 

ffi= U U U 4>iPo,Ei..n) (36) 

Other connectors are defined from V , -> and [J] , e.g. X Y = ^X V Y and < J > X = ^[J]^X . 

Property 53 (classical propositions). Let X G Cc be a classical proposition. Then, it is clear from 
the definition, that there is E CF such that X = E. 

9.1.2 Interpretation 

Subsequently, we are assuming X,Xi,Y G Cc and p G P . It is assumed Ei C Xi such that Xi_ = Ei . 
It is easily shown that: 

pA l\ ii)Xi = <Pip,Ei.,n) . (37) 

i=l:n 

In fact, it is implied from propositions ()29p and ()33p of the previous section that any combination of 
non-nested modal propositions, like [J]X with X G Cc, by means of classical operators (A, V, — >) is 
equivalent to a disjunction of bla like f\^^i.^{i)Y with Y G Cc ■ As a consequence, any propositions 
of Cc[c], the set of simple modal propositions, is equivalent to a disjunction of propositions like 
p A Ai=i n(0"^« • Now, in the case where axioms T also holds, it is easily derived that: 

p A {i)'vEi = -L , for any Ei-n ^ P such that p ^ ^ Ei , 

i=l:n i=l:n 

which is the logical counterpart of the definition of (j35p . It follows from these remarks that our 
model (assuming that it fulfills actually the axioms) have completude property while restricted to 
Cc[c], so that: 

[X\ = [Y\ if and only if X = Y , for any X,Y e Cc[c] ■ (38) 
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In the case, where axiom T does hold, it is also noticed that the following characteristic constraints 
is obtained for the simple modal propositions: 

l\Yi=^ implies l\ {Ji) \Yi\ = ± , for any Yi-.^ G Cc ■ (39) 

i=l:s i=l:s 

From the model definition, it is also clear that this constraint is sufficient to infer the consequence of 
axiom T on the modal propostions. This discussion about the models is now completed by verifying 
the axioms. 

9.1.3 Axioms checking 

The classical axioms are implied since the model is a power set. Other axioms are derived as follows. 
Property 54 (axioms verification). 

Partition: Vpgp P = X ^'^'^ p A (7 = _L = , for p,q £F such that p ^ q , 
N: [J]T = T, 

K: [J]{^XVY) n [J]X C [J]Y, for any X,Y eC, 
Inc: [J]{X) C [J U K]X , for any X,Y e C , 
Ind: [JLJK]v^C Uf,gcp { [J]^F r\ [K]wG ] . 

FnGCE 

T: [J]{X) Q2^, when the model follows definition i35\) . 

Proofs indications are given in appendix [Bj 
9.2 From logical combination to belief combination 

The interpretation of belief functions and belief combinations by means of modal propositions needs 
the concept of probability over logical propositions. 

Definition 55 (probability on logical propositions). Let \_J^\ C [jCJ be a finite set of propositions 
of [£J , closed under the classical operators (i.e. — )• and _L and derived operators). A probability 
distribution over [J^J is a mapping P : \_J^\ — ?• IR such that: 

P>0, P(T) = 1 andP{[X\) + PilY\)=P{[X\AlY\)+P{lX\VlY\). 

Now, it is assumed s sensors characterized by the subsets Ji-s Q I , such that Jj n Jj = for 
any i ^ j . The logical framework \_J^\ is then constructed as a classical closure of the sets of simple 
[Jj]-modalities, i.e.: 

m[X\/i = l:s, [X\ € [Cc\}Q[T\ ,. 
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The set [T] is a finite set. It happens from previous properties that the propositions Aj=i-s(«^«) L^d i 
for [Yi-sl L^cJ ; constitute a partition generating [T\ and that [IJi=i s Ji] L^J ^ L-^J • I* is then 
possible to define the notion of belief, based on a probability defined over the framework [J^J . 

Definition 56 (belief as probabilistic modality). It is defined Beli([Xj) = P{[Ji] [X])- P{[Ji] [_LJ) 



and: 

Bell eH---eH Bel,(LXj) = P 
for i = 1 : s and for any lX\ £ [jCc'J • 



.i=l:s 



[XJ - p 



.i=l:s 



Prom this definition and the properties of (J), especially property ([33]) . a definition of the bbas 
and of their combinations is recovered. 

Property 57 (logical definition of bba). mi{[X\) = P{{Ji)[X \) , and: 



■■S.-,.AYA = \X\ \i=l:s / 



mieH---eHm,(LXj) = P\ |\{J^)[y^\ \ ■ (40) 

Lyi:.jGL£cJ:A.=i:. Vy^\=Vx\ 

In order to reduce P {f\i=i-s{Ji)\Xi\) ■, the independence of the disjoint sources Ji-s is instru- 
mental in a probabilistic paradigm. The idea is to compute P {/\i=i.g{Ji)\Xi\) by maximizing the 
entropy of P over the logical framework : 

PGargmax ^ -Q[ |\{Ji)[Y^\]\nQ[ l\{Ji)[Yi\\ , 

^ Ln:sJeL^cJ Vi=i:. / \^=l■.s J (41) 

u.c. Q {{Ji)[Yi\) = m^{{J^)[Y,\) for any i = 1 : s and [^1:.] G [C-c\ ■ 

Combining ([IO]l and (jS]), it becomes possible to derive mi ©h • • • ©H "ig from mi-g ■ Two cases 

arise, which are consequences of the model constructed in previous section: 

• Axiom T is removed. Then, it is possible to have Ai=i s('^«) L^d 7^ ^ even if Aj=i-s^j = -L > 
as seen in the model construction. As a consequence, the optimization implies the conjunctive 
rule. We are in the hypothesis of an open world. 

• Axiom T is used. As seen in the model construction, this axiom reduces in the constraint p9p 
for the simple modal propositions. As a consequence, it is necessary to consider the constraint 
Ai=i s(<^i) L^d = -L 5 when Ai=i-s L-^d — • This results in the following implied constraint in 
the optimization ()4ip : 



/\ [Yi\ = ± implies Q I f\ {Ji)[Y,\ j = . 

i=l:s \i=l:s / 



The rule EMR is thus derived, from a logical interpretation. Moreover, we are able to dis- 
tinguish between the open and closed world hypotheses. From a modal point of view, the 
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closed world {resp. open world) hypothesis means that [J]_L — )■ _L is necessary {resp. is false 
in general). Prom this modal interpretation, it appears, that the experts from an open world 
may imply contradictions from factual information (typically because his knowledge of the real 
world is not exhaustive). 

10 Conclusion 

A new combination rule have been defined for combining belief functions. This rule is derived 
from a logical derivation, based on axioms of a multimodal logic, and from a principle of sources 
independence, based on the maximization of the system entropy. This contribution implies a versatile 
framework for defining the combination rules and their implied intuition. Indeed, it is possible to 
derive many other logics for defining the notion of belief and their combination at a logical level. 

In this contribution especially, we proposed a logic with strong but desirable properties, and we 
derived some conlusions about the feasibility of the related combinations. These properties are 
typically the conservation of belief during the combination, and the compliance with a probabilistic 
ground truth. It appeared that such a rule is theoretically constructible. But however, it appeared 
that as soon as the principle of independence is used, it introduces information which imply a bias 
which is conflicting in general with the ground truth. This information should be used at the final 
stage of the fusion, which is a strong constraint on the fusion process. We then questioned about the 
need to release the principle of belief conservation (as do most rules with conflict redistribution) or 
to abandon the compliance with a ground truth reference. We also suggested that these issues may 
be solved by using conditional belief functions more thoroughly instead of absolute belief functions. 
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A Proofs of section [4] 

For the sake of simplicity, somes proofs are done for s = 1 or s = 2. But these results are easily generalized 
to s > 1 sources. 
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and 



Belief sharpening property 1131 — < is an order relation. 
Proof. 

Proof of transitivity. Let ri3 be defined according to (I10[) . 
Then, it is clear that ria > 0. 
It also comes: 

E ^^^^^%^^"^2(^2) = E r23(X2,X3) = m3(X3), 
E ^13(X„X3)= E E ^.3(X2,X3) = 

E ^^i^%^-2(X2) ^ E rMX,,X,) = m,iX,). 

Now, since ri2{Xi, X2) = for any Xi,X2 € such that X2 % X\, and ?'23(X2,X3) — for any ^2,^3 G 
G"=' such that X3 ^ X2, it comes that ri2(Xi, X2)r23(X2, X3) = for any Xi,X2,X3 e such that 
X-i%X\. As a consequence: 

ri3(Xi,X3) = for any Xi,X3 e G® such that ^3^X1, 

which also results in: 

E ri3(Xi,X3)= E r^z{X^.X^), 

XiGG^ Xi-.XsCXi 

and 

E ri3(Xi,X3)= E '^13(^1,^3). 

Then, ri3 is indeed an sharpening from Beli to Bel3 . 
Proof of reflexivity. 

The reflexivity itself is obvious, since r, defined by r{X, X) — m{X) and r{X, Y) = for any X,Y ^ G® such 
that X y^Y, will check all requirements for a sharpening from Bel to itself. 

Now, assume another sharpening r' from Bel to itself. Then, there are propositions X G G® such that 
r'{X,X) < m{X) . Let Xm G G® be a maximal proposition, in regards to the order C, such that 
r'{XM,XM) < to(Xm) ■ It comes from this definition: 

r'{XM,XM) < miXM) and r'{X,XM} = , 

for any X e G® \ {Xm} such that Xm C X . As a consequence: 

E r'{X,XM) <m{XM) , 

XSG^ 

which is a contradiction with the hypothesis. 

Proof of antisymmetry. 

It comes from the transitivity that: 

V. n2{X^,X2)r2i{X2,Y,) 

■^-^ W2(A^2) 

X2eG^ ^' 
is a sharpening from Beli to Beli . From the unicity of this sharpening, it comes: 

r-12(Xl, ^2)^21(^2,^1) 

TFl =miXi), 42) 
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and 

^ 7712 (X2) ^ ^ 

for any Xx G and Yi G \ {Xi} . Similarly, it is obtained: 

r2\(X2,Xx)rx2{Xx,X2) , . , . 

^ --2(^2), (44) 

for any X2 G G® . 

Since ri2(Xi,X2) = or 7-2i(X2,Xi) = when X\ ^ X2, it comes from equations and pi]) : 

ri2(Xi,Xi)r2i(Xi,Xi) 

7772 (Xi) 

and 



7771 (Xi) for any G G^ , 



r2i(X2,X2)ri2(X2,X2) IV \ ( V ^ ne 
— — = m2{X2) for any X2 G G"^ . 

777,1 (X2) 

As a corollary, and since < 777^ and Vij < m.j , it comes: 

7772(X)^0 ^ 777l(X)^0 ^ ri2(X,X)^0 ^ r2l{X,X)^{). 

Since ri2 > and r2i > , it comes from equation (j43p : 

ri2(Xi,^2)-0 or r2i(X2,ri)-0, 

for any ^1,^2 G G® and Yi G G® \ {Xi} . By applying this result to X2 — Yi and X2 7^ ^1, it is derived 
ri2(Xi,X2) = when 7772 (X2) 7^ 0. Since anyway < ri2(Xi,X2) < 77i2(-''^2), it follows the result: 

ri2(Xi,X2) = for any ^1,^2 G G® such that Xi X2 . 

Similarly, it may be proved: 

r2i(X2,Xi) = for any ^1,^2 G G® such that Xi ^ X2 . 

As a consequence: 

ri2(X,X)= r^2{X^,X) = m2{X)= ^ r2i{X,X{) 

XieGQ Xieae 

= r2i{X,X)^ J2 r2i{X2, X) ^ mi{X) . 



□ 



Belief sharpening — property 1141 — Beli < Bel2 implies Beli < Bel2 . 
Proof. Let ri2 be a sharpening from Beli to Bel2 . Since: 

{(yi,r2) / Y2 c Fi c X} c {(yi,y2) /Y2CY1 and Y2CX} , 

it comes: 

Beli(X)= J2 ^i2(i"i.^2)< J2 J2 n2iYi,Y2) = Bch{X) . 

Yi-.YiQX Y2:Y2QYi Y2:Y2QX Yi:Y2<ZYi 



□ 



Neutral element — property 1181 — 777 ©h exists, and 777 ©h v = m. 

Proof. Since foiY^Z) = v{Z) and fo > , it is deduced fo{Y,Z) = miless Z = Q. Now, since 
J2z fo{Y, Z) — 777(F), it is concluded: 

fo{Y, Q.) = 7r7(r) and fo{Y, Z) = for Z ^ fl . 

Since this function obviously satisfies the constraints, the existence of 777 ©h is implied. Then the result 
777 ©H 7^ = 777 is immediate. □ 
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Conservation of belief — property 1191 — Beli <i Beli ©h Bel2 . 

Proof. By definition, mi ©h 'm2{X) = J2vw-vnw=x fo{V, W) , where /„ is an optimal solution to (|9]). 
As a consequence, mi ©h 'm2{X) — J2v '^l^' ' where: 

r{V,X)^ fo{V,W). 
W:Vnw=x 

Now r verifies r{V, X) — ioi X (;t V and, since J2w fo{V, W) — mi(V"), it comes: 
X x,W:Vnw=x w 

□ 

Corollaries are obvious. 
Probabilistic bound — property 1231 

Proof. The existence of Beli ®h ■ ■ • ©h BeU ©h P is a consequence of the combination of dominated belief 
function, since, indeed, P <] P . 

From the conservation of belief, it happens: 

P < Bell ©H • • • ©H BeU ©h P ■ 

Since P is a probability measure, it is minimal and the property is implied. □ 

Idempotence — property 1261 — m is probabilistic m ©h • • • ©h m — m. 
Proof. Since m is probabilistic, there are Xi.n G \ {0} such that: 

y^m(X,) = l and I ' ^ "' 

As a consequence, the only function /, which fulfills the constraint of is defined by: 

fix, ■ • • , X) = m{X) for any X e . 
Of this, the property is an immediate consequence. □ 

B Proofs of section [8] and [9] 



Bla exclusivity property | 

Proof. It is noticed that EnFCEorEOFCF when E ^ F . Then, the proof is achieved by deriving: 

{J)vE A{J)vF = [J]vE A[J]vF A I /\ -[J]vG j A I /\ -[J]viJ 

\gce J \hcf 

and combining it with [J]vE A [J]vF = [J]{-vE A vF) ee [J]v(£; HE). □ 

Bla exhaustivity — property 1451 — 

Proof. The proof is recursive. 

It is first noticed that [J]v0 = ( J)v0 . 

Now, let C P and assume Vgc_f('^)vG [J]vF for any F C E . 
Then: 

V ( J)vF EE {J)^E V I V V ( J)vG ] EE {J)vE V I V [J]v^^ 



It follows \/p^j^{J)wF EE [J]wE V [y p^j^[J]wFj , from the difinition of (J)wE. 

Since the modality is non-decreasing, it is deduced \J p(ze{J)^P = [J]^^ ■ ^ 
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Computing the combination — property 1491 and lemma 1511 

Proof of lemma. From (I23p . (j20p and axiom /nd, applied on J U X, it comes: 

Y ([J]vF A [ii:]vG) EE [JUXjvi; . 

FnGCB 

Then, by [J]vF = \/ p^^p.{J)vF2 and [K]vG = \/ (.^^(.{K)vG2 , it comes: 

[JUK]E= y y y ((J)vF2 a (X)vG2) = V ((J)vF2 a (X)vG2) 

FnGCE F2QF G2CG F2nG2CE 



Main proof. From the definition of the bla and lemma, it is deduced: 

{JUK)E= y ((J)vFA (X)vG) A- Y {{J)wF A {K)wG) 

FnGCE FnGCE 

The propositions ( J)vF A {K)vG constituting a partition, it comes: 

{ JUK)E= y ((J)vF A (X)vG) . 

FnG=E 



□ 



□ 



Axioms verification property 

Proof sketch. Partition, K , N and /nc are almost immediate from the definition. Axiom K is derived from 
the definition of [ J] • • • and from the property: 



f]Ej C{T\X)UY and f] Ej C X imply f]Ej CXnYCY. 

]CJ jCJ j€J 



Axiom Ind follows from the following derivation: 



[JUK]yrE = (J U U 0bo,i?i:«) 

PoGPS/VfjuK) EjuK-.n.eJ^KE.CE 

= U U U U '/'(PO,i?l:«) 

PoCP Ej\^juK) FnGCE f fl jEj C~F 



At last, axiom T is derived from the following derivation based on hypothesis (1351) : 

[J]^E = U U U 0(po,i?l:„)= U U U HPO,El..n) 

poeP-Ej\j £;j:njgj EjCE Po6-BEj\j^^.pj-^J-E~c"E 

PoCE Ei 

and from the property [J]X — [J]vit(X) , where 7r(X) = M ecp^ecx 

E. □ 
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